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THE EXTENT OF THE RELATIONSHIP OF THE BOTEL READING 
INVENTORY, FORMS A AND B, AND SELECTED STANDARDIZED TESTS TO 
THE INSTRUCTIONAL READING LEVEL OF PUPILS IN GRADES 1 TO 6 
WERE INVESTIGATED TO PROVIDE EVIDENCE CONCERNING THE VALIDITY 
OF xhE TESTS. THE COOPERATIVE CHECKOUT WAS EMPLOYED AS A 
CRITERION. TEACHER OBSERVATION AND PUPIL ORAL READING FLUENCY 
WERE ALSO USED AS VALIDITY CHECKS. CORRECT GRADE PLACEMENT 
WAS BASED UPON EASE OF READING AT, BELOW, OR ABOVE GRADE 
LEVEL. ALL READING TEST SCORES WERE CORRELATED WITH THE 
CRITERION, THE INSTRUCTIONAL LEVEL OF THE PUPILS, AND THE 
BOTEL INVENTORY WAS CORRELATED WITH THE STANDARDIZED TESTS TO 
PROVIDE INFORMATION ON THE CONGRUENT VALIDITY OF THE 
INVENTORY. RESULTS INDICATED THAT, EXCEPT FOR THIRD GRADE, 

THE BOTEL READING INVENTORY MIGHT BE SUPERIOR TO THE 
STANDARDIZED SILENT READING TESTS USED IN THIS STUDY IN 
PLACING PUPILS AT THEIR CORRECT INSTRUCTIONAL LEVELS. IT WAS 
FOUND THAT WHILE THE STANDARDIZED TESTS OVERPLACED MORE 
PUPILS THAN DID THE BOTEL READING INVENTORY, MANY PUPILS WERE 
EITHER CORRECTLY PLACED OR UNDERPLACED BY THE STANDARDIZED 
SILENT READING TESTS RATHER THAN OVERPLACED. IT WAS NOTED 

xhat Some able pupils were limited to grade level on basal 

READING MATERIAL OR, AT MOST, TO ONE GRADE LEVEL BEYOND GRADE 
PLACEMENT, DESPITE THE FACT THAT THEIR PERFORMANCE IN ORAL 
beading and comprehension was ALMOST PERFECT. REFERENCES AND 
TABLES ARE PROVIDED. THIS PAPER WAS PRESENTED AT THE 
INTERNATIONAL READING ASSOCATION CONFERENCE (BOSTON, APRIL 
24-27, 1968). (MC) 
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Kerlinger has observed that often "Tests are.,. used as substitutes 
for perhaps less convenient > more difficulty or otherwise cumbersome 
modes of measurement and evaluation." (^) 

The problem of testing pupils to find their instructional levels 
in reading is a case in point. Ideally such a determination should be 
made directly in the materials themselves. Given the fact that basal 
reading materials are scaled into carefully controlled sequences and 
given the generally accepted notion that pupils ought to be reading 
with a certain minimum degree of comprehension and oral reading fluency, 
such an evaluation can be readily made if there is sufficient time. 

Each pupil would read, orally and silently, random passages at a 
number of levels of difficulty until he performed with the required 
degree of success. Hut the question of convenience and difficulty for the 
classroom teacher is very much a problem. With 25 to 35 pupils in a class, 
many teachers believe that there is insufficient time to prepare such 



*Research Report delivered at the Thirteenth Annual Convention, Inter- 
national Reading Association, Heston, Massachusetts, April 26, 1966, 
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a test and to evaluate pupils in this ideal way* 

Where the performance of pupils cannot he evaluated directly in 
their materials to find their level, what test should he substituted? For 
some, this questiout- is answered simply: Test them on an informal reading 

inventory* An informal reading inventory is, after all, a series of sam- 
ples from a particular series of graded hasal readers* By hu,ving pupils 
read silently and aloud and hy having them respond to questions based on 
the reading, it is possible to determine the levels at which the desired 
fluency is obtained by the pupils. They are then given materials to read 
at this level* 

There are at least four problems, however, that need to be consider- 
ed concerning the validity of an informal reading inventory. The infor- 
mal reading inventory may not be comprised of a good set of samples* The 
samples may be taken from a series not actually to be used for instruction 
The questions used to measure comprehension may vary in difficulty de- 
pending on the formulator* The notions of the examiners may vary with re- 
spect to the degree of fluency and comprehension needed to establish the 
pupil’s instructional level* 

The four problems posed above are validity questions which have us- 
ually been ignored in developing and using informal reading inventories. 
Yet, such queries suggest the complexity of the problem of placement of 
pupils if anything other than the instructional materials themselves are 
used to place pupils at the right level* Furthermore, they indicate the 
need to establish the extent of validity for instruments that purport to 
determine the ins true ti^'nal level of pupils* The informal reading in- 
ventory may not be exempted from the requirement of other tests that its 



validity (and reliability) must be determined* 



PURPOSE OP THE STUDY 

It was the main purpose of this study to determine the extent of re- 
lationship of the Hotel Reading Inventory (Forms A and B) (2) and several 
standardized tests (^he California Reading Test in Grade 2 (^), «he aver- 
age of the reading sub-tests of the Iowa Tests of Basic Skills in Grade 3 
( 4 ), and tb© STEP Tests in Grades 4-6 ( 6 ) ) to the instructional reading 
level of pupils in grades 1 to 6, thus providing some evidence with re- 
spect to the concurrent validity of these tests. The instructional read- 
ing level or criterion in this study is the placement of pupils in their 
basal readers at the time the several tests were administered. The val- 
idity of the criterion is thoroughly discussed ••Procedures* " 

A second purpose of this study was to determine the relationship 
of the Botel Reading Inventory to the standardized silent reading tests 
used in this study, thus providing some evidence with respect to the 
congruent validity of these tests. 

HYPOTHESES 

1. There is no significant relationship betvieen the Botel Reading In- 
ventory raw scores and the criterion* 

2. There is no significant relationship between the several standardized 
tests grade equivalent scores and the criterion. 

3. There is no significant difference between the relationship of the 
Botel Reading Inventory with the criterion and the standardized tests 

with the criterion* 
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4 # Th©r© is no significaii't rslationship between the Botel Reeding In- 
ventory raw scores and the standardized reading tests grade equivalent 
scores. 

5. There is no significant difference between the Botel Reading In- 
ventory instructional level scores and the standardized silent reading 
test grade equivalent scores in their relative ability to place a pupil 

at his instructional reading level. 

0 

PROCEDURiS 

Establishing a Valid Criterion 

According to Kerlinger '’The single greatest difficulty of predic- 
tion validation is the criterion. Often criteria don*t exist or valid- 
ity is doubtful." (^) Certainly the same thing can be said of the cri- 
terion in concurrent validity studies. In connection with this study of 
the validity of the Botel Reading Inventory (Forms A and B) and various 
standardized reading tests, an attempt was made to carefully establish 
the most valid criterion possible. This was done by selecting a school 
for the validation study which carefully places its pupils in graded 
readers at their instructional levels. Prom the pre-primer level on, 
pupils are advanced from one reading level to another based upon their 
mastery of earlier levels. Mastery is established when the pupil can 
read aloud with 95 per cent or better fluency on the average and with 75 
per cent or better comprehension on the average in the books they have 
completed. A description of this method will be found in How To Teach 
Reading (l)# The procedure is called the Cooperative Checkout. 

In the case of the Penn Valley School, used in this study, the 
principal, Dr. Dorothy Ingalls, had checked and approved the advancement 




of each pupil from instructional level to instructional level# Each 
pupil* s advancement was based on Lis observed fluency and comprehension 
in his basal readers and workbooJs following the standards described above# 
In other words, pupils in the Penn Valley School may be said to be read- 
ing at their proper instructional levels# 

To further establish the validity of this criterion, two further 
checks were made by the investigator# First, at his request, a record 
was kept by each teacher for one semester of the percentage of accuracy 
of pupils on all workbook exercises in their reading program# In every 
case the average pupil-performance in these workbooks pages (which were 
completed independently by the pupil) was 75 per cent or higher# Second, 
the investigator checked each pupil’s oral reading fluency in stories 
they had not been exposed to immediately following those they were work- 
ing on currently# In each case the pupil was able to read orally at 
sight with 95 per cent fluency or better# 

While correct placement was confirmed for those pupils reading be- 
low grade level, those reading at grade level and above presented a pro- 
blem# For, in some classrooms, pupils who could read above grade level 
were not advanced to these higher levels# And in no case were pupils 
allowed to read more than one grade level beyond grade placement in the 
basal reader program# (Able readers, however, were unrestricted in their 
choice of library books#) The effect of this restriction of placement 
in basal readers from the point of view of this study is to limit the 
effectiveness of the criterion for those reading at grade level and be- 
yond# 

Thus, for pupils who are reading below grade level and to a lesser 
extent for those reading at and above grade level we have established the 
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corr©ctn©ss of* th©ir plac©m©iit in basal r©ad©rs» This s©rv©s as a valid 
critsrion for d©t©rmining the rslative pow©r of sevsral t©sts to prsdict 

th© corr©ct plac©ia©nt of pupils* 

Two basic types of comparisons w©ie made among the variables; 

(l) correlations and (2) matching* (All tests were administered by the 
classroom teachers in early February 1967*) 

Correlations * All reading tests wer<^ correlated (using the Pearson- 
ian, product -moment correlation) with the criterion described earlier — 
the instructional reading level of che pupils* Further, the Botel Read- 
ing Inventory (Forms A and B) were correlated with the standardized tests 
to provide information on the congruent validity of the Botel Reading 
Inventory# 

In the case of the criterion the score used was grade level in 
tenths of a year depending upon how far pupils had advanced in the Ginn 
readers which were used as basal in the Penn Valley School* 

Matching , The instructional levels given by the Botel Reading In- 
ventory (Forms A and B) and the grad© equivalent scores of the standard- 
ized tests were compared with the criterion on the basis of the extent 
of match* That is, the extent to which each test placed pupils at, 
above, and below their instructional levels, was mapped out# The Botel 
Reading Inventory provides a table in which the instructional levels 
of the pupils are given* In the case of the standardized tests the 
following table was used to convert the grade equivalent score to an 
instructional reading level score; 
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Grade Equivalent Score 



1 . 0 - 1.2 
1. 3-1.5 
1 . 6 - 1. 9 

2 . 0 - 2. 4 

2 . 5 - 2. 9 

3.0- 3A 

3. 5- 3.9 

k,o-k,9 

5. 0- 5. 9 

6 . 0 - 6. 9 

T.O * 



Instructional Reading Level 
Pre-Primer 
Primer 




4 

5 

6 

7 



(Since the STEP tests do not provide a grade equivalent score, these had 
to be determined. The method used was to regard the mean score at each 
grade level given in the table of norms as having the grade equivalent 
designation for the time of the year the test was administered to the 
norming group. Intermediate points were then determined assuming average 
growth of pupils to be regular throughout the ten months in which school 
is in session.) 



Correlations found between the Botel Reading Inventory (Forms A and 
B) and the standardized tests with the criterion are shown in Tables 1 
and 2. It will be seen the tests were highly correlated with the criter- 
ion. 



CORRELATIONAL FINDINGS 



Table 1 



Correlation^’^ Of The Performance Of Pupils 
On The Botel Reading Inventory (Forms A and 

Instructional Levels 
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Table 2 



Correlation^’^ Of The Performance Of Pupils Using Their Grade 
Equivalent Scores^ On The Indicated Standardized Tests Wit 
mvioTT* Instructional Levels 




^BMD03D - Correlation with item deletion - version of March 1, 19«6. 
^Health Sciences Computing Facility, UCLa. 

the magnitude of the r*s# 



Inspection of the r»s in Tables 1 and 2 suggest that the r»s between 

the Botel Reading Inventory (Forms A and B) and the criterion might be 

significantly greater than the r’s between the standardized tests and the 

1 

criterion. These differences were compared by the "t" test and the re- 
sults recorded in Tables 5 and (Since grade equivalent scores were 
used for the standardized tests rather than raw scores as in the case of 
the Botel Reading Inventory, this may have resulted in a lower magnitude 
of r»s for the standardized tests than was actually found.) 



^Hotelling formula — cited in J. P. Guilford, Fundamental Statistics 

in Psychology and jUducation. New York: McGraw Hill, 1965? P» 190* 
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Table 5 

Comparison Of r»s Between (l) Botel Reading Inventory Form A And 
The Criterion And (2) The Standardized Reading Tests And The Criterion 
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Table k 

Comparison Of r' s Between (l) Botel Reading Inventory Form B ind 
The Criterion And (2) The Standardized Reading Tests And The Criterion 



Standardized 

Silent 




^Significant at the .05 level. 
?Not significant. 

^Significant at the .01 level. 
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Th© r©sults of this coinparison indicate that except for grade 3i 
which no significant difference was founds all comparisons show that the 
Botel scores relate more closely to the criterion than the standa/^dised 
silent reading test scores* Seven of these differences are at the *01 
level of significance j one is at the *05 level of significance, two are 

not significant at the *05 level. 

Correlations found between the Botel Reading Inventory and the 
standardized tests are shown in Table 5* I't will be seen that the cor- 
relations are highest in the lower grade levels ranging from *95 in sec- 
ond grade to *55 in grade 6* That is to say the lower the grade level 
the higher the concurrent validity* 
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Table 5 



Correlations Of Botel Reading Inventory (Forms A And B) 
With Selected Standardized Reading Tests In Grades 2-6* 
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*A11 r‘ s are significant at the .01 level of confidence. 
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Table 6 shows how ths scores of pupils on the Botel Reading Inven- 
tory (Forms A and B) and the standardized reading tests match the 
actual placement of those pupils in grades 2-6 who are reading below 
grade level* This group was selected for study for two reasons. First, 
as we have noted, the group reading in grade level texts or above fre- 
quently were able to read at higher levels. Second, the slower readers 
have been believed in the past to be overplaced in reading by standard- 
ized checks. Verification of this notion could be checked by this com- 
parison. 






Table 6 



Percentage Of Pupils In Readers Below G rade Level 
Placed Correctly^ Underplaced, And Overplaced 
By The Botel Reading Inventory (Forms A And B) And 
Standardized Silent Reading Tests Using Placement 

By Teacher As Criterion 
(February 196?) 
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Since inspection of Table 6 suggests that the Botel Heading Inven- 
tory (Forms A and B) more frequently place pupils at their instructional 
reading level than do the standardized tests, the significance of each 
difference was tested using Chi Square (including Yates Correction)* 

This data was grouped in two categories: on level and off level in 

making these comparisons* Tables 7 and 8 summarize the significance 
of these differences for pupils reading below grade level* 



^Formula (11*10) in J* P* Guilford, Fundamental St atistics in i^yoholqgy 
and Education, New York: McGraw Hill, 1965 » P* 240* 



Talile 7 



Relative Ability Of Botel Reading Inventory (Form A) 
And Standardized Silent Reading Tests To Place 
Pupils On Their Instructional Reading Levels 
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Table 8 



Relative Ability Of Botel Reading Inventory (Form B) 
And Standardized Silent Reading Tests To Place 
Pupils On Their Instructional Reading Levels 
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pSignificant at the .001 level. 
^Significant at the .05 level. 
^Significant at the .01 level. 
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All five hypotheses stated in null form were rejected, leading to 
the following conclusions for the population studied: 

1. The Bo tel Reading Inventory (Forms A and B) are more 
closely related to the criterion than the standardized silent 
reading tests used in this study* 

2. The Botel Reading Inventory (Forms A and B) are more 
highly related to the standardized silent reading tests used in 
this study at the lower grade levels* 

5* The Botel Reading Inventory (Forms A and B) place pupils 
reading below grade level at their instructional level more 
effectively than do the standardized silent tests used in this 
study* 

Analysis of the data suggests that for the purpose of placing a 
student at his instructional level, the Botel Reading Inventory might 
be superior to the standardized silent reading tests used in this study* 
Of course, the findings need to be verified with other populations 
before any more general statement of the relative efficiency of these 
tests for such purposes could be made* 

The findings of this study shed some light on the extent to which 
standardized tests place pupils at their instructional levels* The 
generalization is made by some that standardized silent reading tests 
place pupils at their frustration level. In this study it was found 
that while the standardized tests overplaced more pupils than did the 
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Botel Reading Inventory, many pupils were either correctly placed or 
underplaced by the standardized silent reading tests rather than over- 
placed* 

Each school or school system ought to determine for itself the 
validity or relative ability of informal reading inventories and stand- 
ardized tests to place its pupils at their instructional levels. Tab- 
ular procedures like those used in this study for determining extent of 
match should prove useful for such a purpose* 

A more ideal study of the extent of match between various informal 
and standardized tests with the pupils* instructional levels can be 
accomplished by further improving the criterion measures* It seems that 
this would best be done by determining for each student how well he 
reads silently and orally at various levels of one or more scaled or 
graded reading programs* It was noted in this study that some able 
pupils were limited to grade level on basal reading material or at most 
to one grade level beyond grade placement, despite the fact that their 
performance in oral reading and comprehension was almost perfect* In 
an ideal classroom each student must be allowed to read as far beyond 
grade level as his ability and maturity justifies* 
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